Correlation Effects in the Triangular Lattice Single-band System L^NoO^ 
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Superconductivity in hole-doped Li x Nb02 has been reported with T c w5 K in the range 0.45 
< x < 0.8. The electronic structure is based on a two-dimensional triangular Nb lattice. The 
strong trigonal crystal field results in a single Nb d z i band isolated within a wide gap, leading to a 
single-band triangular lattice system. The isolated, partially filled band has a width W=1.5 eV with 
dominant second neighbor hopping. To identify possible correlation effects, we apply DMFT(QMC) 
using on-site Coulomb repulsion U =0-3 eV, and check selected results using determinant QMC. For 
U as small as 1 eV, the single particle spectrum displays a robust lower Hubbard band, suggesting 
the importance of correlation effects in Li^NbC^ even for U < W. At half-filling (x=0), a Mott 
transition occurs at U c sal. 5 eV. Coupling between the O A g phonon displacement and correlation 
effects is assessed. 

PACS numbers: 71. 20.Be,71.20.Dg,71.27.+a, 74.25. Jb 



I. INTRODUCTION 



Not long after the discovery of high temperature 
superconductivity in layered cuprate compounds, 
Geselbracht, Richardson, and Stacy discovered su- 
perconductivity at £=0.45 and 0.50 in the layered 
niobate LLjNbO^ with T c «5 K.[l| Samples were 
obtained by removing Li (hence electrons) from 
band insulating LiNbC>2. This superconductivity 
has been confirmed in the range 0.45< x <0.79 
with T c showing no significant dependence on Li 
concentration, pi 0> 0, El but no superconductiv- 
ity in the weakly doped range between x=0.84 and 
x=l.|| Hall effect measurements confirmed hole- 
type carriers, Q consistent with LiNbC>2 being a 
band insulator. The difficulty in synthesizing mate- 
rials with x <0.45 may be related to the considerable 
covalency of Li along c-direction that is reflected in 
the Born effective charge. 0,0 

Recently, Liu et al. revisited the superconduc- 
tor (a;=0.68) using specific heat measurements. Q 
The electronic specific heat can be fit well using 
the BCS-type s-wave symmetry pairing. Addition- 
ally, the linear specific heat coefficient r y exp =3.59 
mJ/mol K 2 and the Debye temperature 462 K were 
obtained. The virtual crystal approximation (Li nu- 
clear charge Z — 2 + x), leads to the band structure 
value 7f,=2.425 mJ/mol K 2 at x — 0.68, correspond- 
ing to weak electron-phonon coupling strength A = 
l^£. — \ wO.48, which could however be enough to ac- 
count for T c « 5 K. The electron-phonon mechanism 
is consistent with stated theoretical viewpoints. @,@| 

There are two interesting sister materials. An 
isostructural and isovalent Na^NbC^ has been ob- 
served to be superconducting with a little lower 



T c «4 K, in the range 0.5 < x < 0.7. [1 Inter- 
preted as an isotope shift, a = —d(lnT c )/d(lnM) 
(M=mass) is 0.27. This value might be thought 
to imply phonon-mediated pairing, but the impor- 
tant coupling is not expected to be to the Li (Na) 
ion. Another system is H a; LiNb02, showing super- 
conductivity with T c =5 K at x=0.3 and 0.5. Due 
to lack of structure studies as well as doping stud- 
ies, the mechanism and what role H plays are not 
yet resolved. 

In the A^(S,Se)2 system with a transition metal 
M , competition between a charge density wave tran- 
sition (CDW) and superconductivity is frequently 
observed. Recently, Morosan et al. synthesized 
Cu K TiSe2.[I2| By intercalating Cu (i.e., electron do- 
nation from Cu), the CDW is suppressed and this 
system becomes superconducting with the maxi- 
mum T c «4 K at x = 0.08. The Wilson ratio 
R ~ 0.35 is small, implying the importance of corre- 
lation effects. Another compound for comparison 
is Na^CoO^, which becomes a superconductor at 
x ~ 1/3 by intercalating water. Also, the dehy- 
drated compound displays an interesting phase dia- 
gram with unique insulating phase at x = 0.5 and 
shows large correlation effects. As intensively stud- 
ied by some of the present authors, [l3| correlation 
effects in this system lead to charge disproportiona- 
tion on the Co sublattice. 

In addition to the common layered structure, both 
VW(S,Se)2 and Cua;TiSe2 have an edge-sharing octa- 
hedral framework, similar with NbC>6 trigonal pris- 
matic coordination in Lij;Nb02. These similarities 
imply the significance of correlation effects in this 
niobate. At x = (Nb02) Nb has only one valence 
electron (id 1 ) and the possibility of a Mott tran- 
sition naturally arises. The observed structure of 



NbC>2 is distorted rutile,[l4[ and the layered form 
may not be accessible experimentally. 

In this paper, we investigate correlation effects on 
the presumed Mott insulating and nonstoichiomet- 
ric phases using the dynamical mean field theory ap- 
proximation (DMFT).[l5[ Selected results are com- 
pared with determinant quantum Monte Carlo cal- 
culations, where intersite correlations are included 
and the only limitations are the lattice size and 
the temperature. For varying strength of repulsion 
(whose value is not known), and for fillings n=l, 4/3, 
and 5/3 (note n = x + 1) we obtain the spectral den- 
sity, and at n=l we identify the critical strength for 
a metal- insulator transition, and display the evolu- 
tion of system characteristics through the transition. 
Finally, we present changes in the spectral density 
due to (frozen) A g phonon displacements. 

The triangular lattice aspect itself has assumed re- 
newed interest, due in part to the discovery of super- 
conductivity in the Na^OoC^ system. The nearest- 
neighbor triangular Hubbard model has been stud- 
ied to uncover how it differs from the square lat- 
tice that is used as a model of the high temper- 
ature superconductors; its non-bipartite nature is 
found to be important in frustrating local spin cor- 
relations. We will compare results for Li^NbC^ 
where 2nd neighbor coupling dominates, to the 
same dynamical mean field approximation calcula- 
tions for the nearest-neighbor case of Aryanpour and 
collaborators. [HI 



II. STRUCTURE AND CALCULATION 

LiNbC>2 is based on a double-layered hexagonal 
structure {Pd^/mmc, No. 194) with lattice param- 
eters a=2.90 A and c=10.46 A.@, S, M, M, M, HJ 
Li and Nb atoms lie on 2a sites (0,0,0) and 2d 
sites ( respectively. O atoms occupy 4/ sites 
(i,|,z). In this material, NbOg units place the Nb 
ion in trigonal prismatic coordination. The O in- 
ternal parameter z, which is measured from the Li 
layers, shows some disagreement between reports, 
and our calculations use the experimental value 
z=0.1263[l8j for which the electronic structure was 
analyzed earlier. Q This value leads to Nb-0 bond 
length 2.116 A, and O-Nb-0 bond angles 86.5° and 
75.4°. 

We have carried out first principles, local density 
approximation (LDA) calculations using the full- 
potential local-orbital code (FPLO),[2l[ and the re- 
sults are consistent with previous reports. [H 0] The 
basis set was Li (Is)2s2p3d, Nb (4s4p)5s5p4d, and 
O 2s2p3d. (The orbitals in parentheses indicate 
semicore orbitals.) As reported previously, [f| Q the 
electronic structure shows strong two-dimensionality 
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FIG. 1: (Color online) Two-dimensional tight-binding 
band structure and density of states, using up to third 
neighbor hopping parameters (£i=64, £2 = 100, and £3=33 
meV), for the single isolated d z ? state in LiNb02- The 
dashed horizontal lines indicate the Fermi energy Ef in 
the rigid band picture for electron fillings n=l, 4/3, and 
5/3 from bottom to top. The centroid of the band Eo 
lies on 18 meV below Ef for n=4/3. Note lower half of 
weight is localized within 0.2 eV width, only 13 % of the 
total bandwidth. 



and for our investigation of correlation effects we 
neglect the k z dispersion. Our DMFT calculations 
were carried with two-dimensional tight-binding 
(TB) parameters £i=64, £2=100, and £3=33 meV, 
leading to bandwidth W=l.h eV. These hopping 
parameters were obtained using Wannier function 
techniques. [6| The TB band structure and DOS are 
displayed in Fig. [TJ 

Studies of lithium-deintercalation in the range 
0.5 < x < 1 by Kumada et al. display negligible 
change in the structure parameters including Nb- 
O bond length. 

[13 

This behavior is consistent with 
the observation that the electronic structure follows 
a rigid band model well. @, d, H3| Thus these tight- 
binding parameters will be used for all x. (Since 
another structure 14J is observed, 2i2-Nb02 as con- 
sidered here would be at best a metastable state.) 

Hirsch-Fyequantum Monte Carlo (QMC) DMFT 
calculations [l5 1 were carried out to investigate 
dynamic correlation effects, applying the on-site 
Coulomb repulsion U less than 3 eV to the single 
isolated d z i Wannier function. The DMFT study is 
based on the Hubbard model 
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with the hopping parameters ty between site i and j, 
the chemical potential /x, the spin quantum number 
a, c^ a creates an electron of spin a at site j, and 

riia = cl a Cia is the number operator. The results 
reported here are for T=1100 K (i.e., 0.1 eV). 40- 
100 time-slices are used for the QMC runs. 



The spectral density A(u>) has been obtained 
using the maximum-entropy (MaxEnt) analytic 
continuation technique developed by Jarrell and 
Gubernatis.[22| In MaxEnt good QMC data, close to 
Gaussian distribution, are crucial. We checked the 
statistics up to 12xl0 6 sweeps and also about 500 
fc-points in the two-dimensional irreducible wedge. 
However, at small and large U regimes, the spec- 
tral densities, specially near oj = 0, depend notice- 
ably on the convergence parameters. In this paper 
we will show the results in range of 11=0.5-2.5 eV, 
which shows robust results for A(u). MaxEnt can 
be performed in a few different ways. In our cal- 
culations, both classic and Bryan techniques have 
been used and show consistent results. The other 
ingredient in MaxEnt is the default model for the 
spectral density. [22| Since the default model is im- 
material for good data, two different ways based on 
a Gaussian model were tried. One is independently 
calculated using the same default model for each U, 
and the other way is that a converged result for pre- 
vious higher U value is used as a default model for 
next small U . These methods give consistent results, 
indicating the robustness of results from the MaxEnt 
technique. 



The bulk of our results have been obtained with 
this DMFT approach. To assess whether intersite 
correlations may affect our conclusions, we comple- 
ment them with a limited set of simulations using de- 
terminant quantum Monte Carlo (DQMC) [2^|, per- 
formed for the same Hamiltonian, Eq. 1 but on finite 
spatial lattices. This approach includes the momen- 
tum dependence of the self energy, but has the draw- 
back of not working in the thermodynamic limit, as 
DMFT does. As in the DMFT QMC solver, DQMC 
requires a discretization of the inverse temperature 
(3. We have chosen the interval At = 0.5 which 
satisfies the condition tiU(Ar) 2 << 1 required for 
the 'Trotter errors' associated with the discretization 
to be small. Our runs typically used 2,000 sweeps 
to equilibrate the lattice and 20,000 sweeps to take 
measurements. We have looked at the density and 
short range spin correlations on 12x12 lattices in 
addition to the 9x9 lattice results shown here, and 
observe only minor changes. 
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FIG. 2: (Color online) Top: Electron filling n versus ef- 
fective chemical potential fi* = /j, — U/2, when changing 
the on-site Coulomb repulsion U. The lines and sym- 
bols are the results of DMFT and DQMC calculations 
respectively. The excellent agreement is partly a con- 
sequence of the magnetic frustration of the triangular 
lattice which diminishes the importance of including in- 
tersite correlations (see text). Even for 17=1.0 eV, the 
slope changes significantly near half-filling, which is in- 
dicated by the dashed horizontal line. Above (7=1.5 eV, 
there is a plateau at half-filling. Inset: n vs. U plot 
at /i*=0.05, which displays clearly a metal-to-insulator 
transition completing (n — » 1) near (7=1.5 eV. Bottom: 
Compressibility « = dn/dfi versus fi* near the critical U 
regime, showing more clearly where it approaches and 
becomes vanishingly small. 



III. METAL-INSULATOR TRANSITION 

A. Electron Filling versus Chemical Potential 

We first address the metal-insulator transition 
(MIT) at half-filling. When a gap exists, the occu- 



3 




n 



FIG. 3: (Color online) Determinant QMC result for the 
spin-spin correlation function for temperatures of 1100 K 
(/3=10.9) and 750 K (,3=16), versus versus band filling n. 
U=l, and energies are in eV. The 5th neighbor (5nn) is 
the third neighbor along a straight line from the reference 
site. 



pied electron density remains unchanged for values 
of the chemical potential /i within the gap. This 
behavior can be observed as a plateau in electron 
filling n([i) plots as U is increased, and is displayed 
in the top panel of Fig. [2j Since there is a Hartree- 
Fock-like shift of the entire spectrum with U for the 
form of Hamiltonian we use, the chemical potential is 
shifted simply by {7/2 and denoted by fi* . Already at 
U=l eV, an inflection is clear near half-filling. This 
inflection point becomes a plateau of ~0.1 eV width 
at C/=1.5 eV, indicating proximity to the MIT. 

The critical coupling strength U c for the MIT can 
be determined more precisely using two different 
methods. First, choosing /i*=0.05 eV (chosen some- 
what above fi* = for clarity), the filling approaches 
unity as U — >1.5 eV, as shown in inset of Fig. [5] (top 
panel). Second, and most clearly, vanishing com- 
pressibility k — dn/d^L signifies the onset of the in- 
sulating phase. The bottom panel of Fig. [2] shows K 
is reduced by an order of magnitude for {7=1.5 eV, 
but only truly vanishes for U close to 2 eV. It must 
be recalled however that the calculations are done at 
T=0.1 eV, and temperature broadening is ~ 7tT in 
addition to other temperature effects, so requiring k 
to vanish overestimates U c . Considering the 
plot in the inset of Fig. [2l we identify U c w 1.5 eV 
as the (low temperature) critical strength. 



Figure shows the intersite spin correlations < 
SfST >, obtained with DQMC on a 9x9 lattice. 
Two temperatures are shown, T = HOOK and T = 
750 K. The dominant tendency is toward antifer- 
romagnetic orientation between 2nd neighbor spins 
connected by ti, which is certainly reasonable given 
that it is the largest hopping, and hence has the 
largest value of J = 4t 2 /U. This short-range order 
increases strongly as T is lowered, and the asymme- 
try around half-filling becomes sharp and more pro- 
nounced. Near neighbor spins, connected by t\, have 
a correlation which is almost an order of magnitude 
smaller, and its increase with lowering temperature 
is less pronounced. This small near neighbor corre- 
lation is strongly dependent on band filling, being 
ferromagnetic for n < 1 and antifcrromagnetic for 
n > 1. Interestingly, while the 3rd neighbor spins 
connected by t% are essentially uncorrelated, spins 
which are separated linearly by three lattice con- 
stants (5th neighbors), for which there is no direct 
hopping, exhibit significant antiferromagnetic corre- 
lations for n < 1 and ferromagnetic correlations for 
n > 1, i.e. opposite in sign to the near neighbor cor- 
relation. Overall, the local spin order is markedly 
different on the two sides of half-filling, n = 1, in 
contrast to the square lattice (and bipartite lattices 
generally) where the order is symmetric about half- 
filling. 

Coupling to second neighbors alone (as occurs 
here, crudely speaking) separates the triangular lat- 
tice into three independent triangular sublattices, 
each with lattice constant \/3a. On each sublattice 
there are "near neighbor" antifcrromagnetic correla- 
tions, which are frustrated on the triangular lattice. 
Near neighbor hopping couples a given site to three 
sites of each of the other sublattices, and antiferro- 
magnetic Inn coupling tends to add to the frustra- 
tion. Third neighbor hopping also connects to three 
sites of each of the other two sublattices, although 
the sites are far enough apart that any additional 
frustration is probably not an issue. This picture 
leads perhaps to even stronger frustration than on 
the simple triangular lattice, and rationalizes why 
the results for n(/z) and the compressibility (and per- 
haps other properties) are so similar in DQMC and 
in DMFT (which neglects intersite correlations). 



B. U-dependent Spectral Density at 
Half-filling 

At half-filling, the MIT can also be observed 
through the evolution of A(u>), shown in Fig. [U 
For U—l eV, the spectral density has clearly begun 
splitting into two parts, the lower (LHB) and up- 
per Hubbard bands (UHB). At {7=1.5 eV, a gap has 
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FIG. 4: (Color online) Effect of the on-site Coulomb 
repulsion U (in units of eV) on spectral density, which 
is obtained from MaxEnt, for n=l. At (7=1.5 eV, a gap 
opens clearly. 



opened, consistent with the identification above of 
U c s» 1.5 eV. The gap increases monotonically with 
U for stronger coupling, as expected. No peak is 
seen at the chemical potential as the gap opens be- 
cause of the relatively high temperature used here 
(roughly three times higher than used by Aryanpour 
and collaborators [l6j for the case of near neighbor 
hopping only). 

This spectral density shows two interesting fea- 
tures. First, this gap opening occurs simultaneously 
with appearance of a low binding energy peak just 
below w = 0. Second, recall that within LDA (U=0) 
half of the weight lies in the lower 13% of the to- 
tal bandwidth (see Fig. [TJ, but that at half-filling 
equal weight goes to the LHB and UHB. The band 
asymmetry fades fairly rapidly as U increases, with a 
remnant peak on the low-binding-energy side of the 
LHB and the high-binding-energy tail on the UHB 
reflecting the structure in the underlying U —Q den- 
sity of states (again, see Fig. [T]). 

In single band near-neighbor models with a sin- 
gle hopping t, the correlation strength is gauged in 
terms of the ratio of U/W with an unambiguous 
bandwidth W. However, in the triangular lattice, 
the tight-binding DOS has a long high energy tail 
and steep lower edge, as shown in Fig. [1] This 
extremely asymmetric shape suggests that W alone 
does not give a meaningful measure of the DOS. We 
define an effective band width W in terms of the 
second moment of the DOS. From W «0.60 eV we 
obtain a critical Coulomb interaction strength ratio 
U c /W w2.5 for the metal-to-insulator transition. 

Using DMFT(QMC), Aryanpour et al. investi- 
gated the half- filled triangular lattice [l6[ with only 




FIG. 5: (Color online) Top: Change in the correlation 
function (m(r)m(O)) of local moment m as U increases. 
Bottom: 17-dependent local susceptibility xioc (left) and 
standard deviation a (right) over (0,[3) for the correlation 
function. The a plot shows that variance of the correla- 
tion function is strongly reduced by the transition to the 
insulating phase. 



nearest neighbor hopping (t = — 1 in arbitrary units) 
for which W «4.9 (the full bandwidth is W = 9\t\ = 
9). They obtained C/ c =12±0.5 eV at a tempera- 
ture of 400 K, or U c /W w 2.5-2.6, the same as for 
Li a; Nb02 0=0) above (carried out at 1160 K). Thus 
in this case the more complex dispersion and altered 
DOS shape has negligible effect on the critical inter- 
action strength ratio. 



C. Local Susceptibility at Half-filling 

At half-filling, the local moment m rms = 
{m 2 z ) = ((n-f — n>i) 2 ) increases from at U=Q 
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to unity for U — -*■ oo. For the half-filled system n=l, 
iTirms = vl — 2d where d is the fraction of doubly- 
occupied sites. The imaginary time correlation func- 
tion of the local moment x( T ) — (m(T)m(O)) con- 
tains additional information about how the mo- 
ment decorrelates in imaginary time from its value 
X{t = 0) = (ml). As shown in Fig. [5j as r increases 
in the range [0,(3/2], %(t) decreases strongly when U 
is small, whereas for U > U c , x{ T ) becomes nearly 
flat. 

The bottom panel of Fig. [5] shows the local sus- 
ceptibility xioc = Jo x( T )dr versus U. When 
U surpasses U c , the local susceptibility rapidly satu- 
rates. The variance a of x( T ) from its average value 
(xioc) is also displayed in Fig. [5j cr(U) drops by 
roughly a factor of 40 between U =0 to U =3 eV, 
having its maximum (negative) slope around {7=1. 



IV. NONSTOICHIOMETRIC PHASE 

In this section, we will address the hole-doped 
phases, specifically two fillings n=4/3 (LiiNbC>2, 
representing the regime not yet synthesized) and 
n=5/3 (Li2NbC>2, representing the reported super- 
conducting regime) through spectral density studies. 
Comparison of these results with experimental data 
will enable the identification of the strength of cor- 
relation effects. 



A. Correlation Effects on Spectral Density 

Figure [6] shows A(uS) for n=4/3 and 5/3. At 
n=4/3, even for {7=1.0 eV, a robust lower Hubbard 
band (LHB) is established. By {7=1.5 cV={7 c the 
LHB completely separates from the more intense 
peak at —0.15 eV. The LHB is clearly identifiable 
and contains about 0.3 electrons per spin, which is 
close to the number of holes per spin 11^—1 /Z. The 
structure around the chemical potential and around 
0.5 eV is persistent as U increases, but is not mono- 
tonic and may not be above the resolution of the 
MaxEnt technique that is used to obtain these spec- 
tral densities. Certainly there is no obvious upper 
Hubbard band that shifts monotonically with U . 

At n=5/3, the LHB appears for U as small as 
0.5 eV. Its weight is near 0.1 per spin indepen- 
dent of {7, and shifts downward almost linearly with 
U; the hole-doping level is n^=0.17/spin. For the 
main spectral weight peak around -0.5 eV and in the 
electron-addition spectrum, there is little change as 
U increases. The LHB can be understood simply. In 
a snapshot of a doped system one would see doubly 
occupied sites and singly occupied sites (for substan- 
tial U). The process corresponding to the LHB is 




FIG. 6: (Color online) Effect of the on-site Coulomb 
repulsion U (in units of eV) on spectral densities, which 
are obtained from MaxEnt, for n=4/3 (top) and 5/3 
(bottom). As expected from the bandwidth, correlated 
behavior already appears at {7=0.5 eV. (For details, see 
text.) Note the spectral densities are normalized, i.e., 
J A(u)duo = 1. 



removing an electron from the singly occupied sites, 
so the fraction of such sites is equal to the number 
of holes, and thus similar to the weight of the LHB. 
This picture seems to be more precise for the higher 
hole concentration (n=4/3). 

Cherkashenko et al. reported[2(| the x-ray emis- 
sion spectrum for Nb Ad — ► 2p transitions for 
Li^NbC^, x=0.97 and 0.71, i.e. for the near band 
insulator and superconducting compositions respec- 
tively. With their low resolution, all that could 
be identified was a decrease in the occupied Nb 4c? 
intensity and some narrowing, without measurable 
shift in the peak, as the Li concentration was re- 
duced. This behavior is roughly consistent with 
a rigid band picture, if the narrowing can be as- 
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TABLE I: Change in direct width W, effective width 
W (see text for the definition), and criticai U c for MIT 
(in units of eV) when O is displaced. See the caption 
of Fig. [7] for the definition of the displacements d+,d_. 
The centroid of the band Eq (in meV) measured from 
the value of Ef for n=4/3. There is a consistent critical 
strength U c /W «2.5. Each tight binding parameters (in 
meV) used here are from Ref. [6J. The compared DOS 
are shown in the top panel of Fig. [7] 
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cribed to the Fermi level moving from the top of 
the band (insulating phase) down into the band 
(metallic phase). However, the edge position did 
not change as it would in a rigid band picture, so 
the interpretation is not certain. Higher resolution 
x-ray measurements, compared with our predictions, 
will be very useful in identifying correlation effects 
in this system. 



B. Effect of Nb-O Bond Stretching Mode 

The calculations of Ylvisaker and Pickett in the 
band insulating phase led to a rough scale for the 
deformation potential V = dW/dz ~ 2.5 eV/A (half 
the bandwidth change per unit displacement), which 
is a substantial value that suggests the importance 
of O displacement Az for electron-phonon coupling, 
i.e. transport and superconductivity. [6j To investi- 
gate effects of the O A g phonon mode on A(u>) we 
have used O ion displacements Az = ±0.10 A along 
the c direction. This displacement is representa- 
tive of the maximum amplitude of the A g mode, 
and it happens to be similar to the variation of 
the S position in NbS2 reported between x=0 and 
£=0.67 in isovalent, isostructural, and supercon- 
ducting Li a: NbS2.[2l H This magnitude of dis- 
placement leads to significant changes in hopping 
integrals, as reproduced in Table [II resulting in con- 
siderably different DOS shape for each O position. 

The DOS (obtained from the tight-binding fit, but 
equivalent to the first principles result) displayed in 
the top panel of Fig. [7] shows that the most sig- 
nificant change is in bandwidth, about ±0.5 eV for 
±0.10 A change in O position giving the mean de- 
formation potential mentioned above. The variation 
of the DOS is not well characterized simply by W 
however, because although W increases, the portion 
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FIG. 7: (Color online) Effect of O displacement on spec- 
tral densities. O is displaced by ±0.10 A in the (001) di- 
rection, do is the optimized position. d_ and d+ denote 
contraction and elongation of the Nb-0 bond length, re- 
spectively. Top: Tight-binding DOS (i.e., U=0) for the 
O displacement. The densities of states are aligned with 
respect to Ef for n=5/3, set to zero. For each case, the 
dashed vertical lines denote Ef for n=l, 4/3, and 5/3 
(left to right). Bottom: Change in spectral densities, 
which shows effects of the phonon mode, at U=2 eV. 
The line designations are the same as in the top panel. 



of the DOS containing ~ 60 — 70% of the states nar- 
rows by roughly a factor of two. As a result, the 
position of Ep and DOS at Ep N(Ep) change sig- 
nificantly for all fillings. This effect is especially op- 
erative at n — 5/3 filling: the shifting of Ep across 
the van Hove singularity reflects the fact that there is 
a transfer of charge (holes, in this case) between the 
low mass hole pocket at T and the higher mass hole 
pocket at the two K points. Since the bandwidth 
W seems to change more than other identifiable en- 
ergy structures, the scale V = 2.5 eV/A mentioned 
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above is probably an overestimate of actual deforma- 
tion potentials at the Fermi surface. The fact that 
O displacement makes the Fermi level shift across 
a van Hove singularity indicates that non-adiabatic 
processes are involved in the neighborhood of n=5/3 
i.e. in the reported superconducting regime. Simi- 
lar non-adiabatic effects were identified[2y] in MgB2, 
and have not yet been treated properly. 

Considering correlation effects within our DMFT 
approach, O displacement affects A(ui) most 
strongly within ±0.5 eV of the chemical potential, 
as shown in the bottom panel of Fig. [7] The LHB is 
hardly affected, either in position or in weight. The 
spectral densities that are displayed are for U=2 eV, 
but for all U studied here the phonon effects are sim- 
ilar. At n—5/3, which is in the range of observed 
superconductivity, A(u> = 0) (the interacting ana- 
log of N(Ep j) fluctuates strongly, while at n=4/3 
A(u> — 0) varies little. The changes occur for ui 
only up to a few tenths of eV. The stronger changes 
for n = 5/3 may arise from the already very strong 
change in the underlying N(Ep), see the top panel 
of Fig. El 

V. SUMMARY 

The single d z 2 band in Li-rNbG^, isolated due to 
large trigonal crystal field splitting, requires three 
neighbor hopping parameters to reproduce its dis- 
persion, second neighbor hopping being dominant. 
This long range of hybridization reflects the fact that 
the corresponding Wannier function is not well local- 
ized, having significant O 2p and neighboring Nb 4c? 
character in addition to the on-site 4d z 2 part. The 
dispersion leads to highly asymmetric DOS which 
contains half its weight in the lower 13% of band- 
width. 

Using DMFT(QMC), we have investigated corre- 
lation effects on the spectral densities and have fol- 
lowed the Mott transition using both the compress- 
ibility and the spectral density. At half-filling, a 
metal-to-insulator transition occurs at U c ss 1.5 eV. 
Because of long tail and steep edge of DOS in the 
two-dimensional tight-banding model for the trian- 
gular lattice, however, we have introduced an effec- 
tive bandwidth W obtained from the second moment 



of the density of states to characterize the band. The 
critical interaction strength ratio U c /W ~ 2.5 for the 
Mott transition is the same as was obtained for the 
triangular lattice nearest neighbor Hubbard model, 
indicating that the more complex dispersion does 
not affect the position of the metal-insulator transi- 
tion in this system. 

Calculation of the spin correlation functions with 
determinant QMC verifies that second neighbor cor- 
relations are by far the largest, as expected from 
the hopping parameters. Spin correlations between 
other neighbors are very minor. We find how- 
ever that the behavior of the band filling n(fi) 
and the compressibility are virtually identical in 
DMFT (which neglects intersite spin correlations) 
and DQMC, justifying a posteriori our use of DMFT 
for this triangular lattice system. The dominant sec- 
ond neighbor hopping t% tends to partition the lat- 
tice into three weakly coupled triangular sublattices 
(lattice constant each of these are frustrated 

with the antiferromagnetic coupling, and the small 
coupling between these sublattices adds to the frus- 
tration. 

The spectral density was used to assess the 
strength and character of correlation effects in 
Li x Nb02, both for the static lattice and for frozen 
displacements of the O A 9 phonon. These re- 
sults were presented for a grid of interaction (U) 
strengths, since the appropriate value for Li x Nb02 
is not yet known. These results will be useful in 
the interpretation of high-resolution photoemission 
data, which are needed to further our understanding 
of this very interesting new triangular lattice super- 
conductor. 
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